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I CLAIM: 

is. A method for evaluating group-administered test results, said 
method comprising: 

\ (a) providing a set of class profiles, each class profile 
indicative of performance of a respective class on a selected group- 
administered test comprising a plurality of questions; and 

(b) \ generating with a computer a normative profile indicative 
of normative class pterformance on the selected test; 

(c) comparing each of the class profiles with the normative 
profile on a question-by^guestion basis. 

2. A method forfevaluating group-administered test results, said 
method comprising: \ 

(a) providing avset of class profiles, each class profile 
indicative of performance of a respective class on a selected group- 
administered test comprising a plurality of questions; and 

(b) generating with a computer a normative profile indicative 
of normative class performance on thevselected test; 

(c) identifying individual ones of the class profiles that 
deviate excessively from the normative prbfile on a question-by-question 
basis. \ 

3. The method of Claim 1 or 2 wherein act (c) comprises identifying 
selected ones of the class profiles that are characterized by a low correlation 
with the normative profile. \ 

4. The method of Claim 1 or 2 wherein act\c) comprises 
comparing (1 ) at least two portions of each class profile That differ in question 
difficulty against (2) corresponding portions of the normative profile. 

5. The method of Claim 1 or 2 wherein act (c) comprises 
comparing (1) a difference between at least a portion of each of the class 
profiles and a corresponding portion of the normative profile on asquestion-by- 
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q\iestion basis; and (2) a measure of expected variability of class performance 
for the corresponding portion of the class profiles. 

Ns. The method of Claim 1 or 2 wherein act (c) comprises 
comparing (1) a measure of difference between a first portion of each of the 
class profiles and a corresponding first portion of the normative profile and 
(2) a measure of difference between a second portion of each of the class 
profiles and a corresponding second portion of the normative profile. 

7. TheVnethod of Claim 1 or 2 wherein act (c) comprises identifying 
successive equal values in each of the class profiles of (a). 

8. The method of Claim 1 or 2 wherein act (a) comprises: 

(a1 ) providing a respective individual profile for each of a 
plurality of individuals trnat took the group-administered test, each individual 
associated with a respective one of the classes, each individual profile 
indicative of accuracy of theVespective individual in answering the plurality of 
questions on a question-by-question basis; and 

(a2) determiningseach class profile from the individual profiles 
of the individuals in the respective\lass, each class profile indicative of 
accuracy of the individuals in the respective class in answering the questions 
on a question-by-question basis. \ 

9. The method of Claim 1 or 2 wherein the class profiles of (a) are 
each characterized by a skill level, and wherein the normative profile of (b) is 
indicative of expected class performance for a class of said skill level. 

10. The method of Claim 1 or 2 wherein the normative profile of (b) 
is indicative of expected class performance for classes^ of a wide range of skill 
levels. \ 

11. A method for evaluating standardized test results, said method 
comprising: \ 



-25- 



(b) providing a set of sub-group profiles, each sub-group 
profile indicative of performance of a respective sub-group comprising a 
plurality of individuals on a selected standardized test comprising a plurality of 
questions; \ 

(b) \ generating with a computer a normative profile indicative 
of normative group performance on the selected test; and 

(c) evaluating administration of the selected test based on a 
comparison of each of\he sub-group profiles with the normative profile on a 
question-by-question basis. 

12. The method of Claim 1 1 wherein each sub-group comprises 
individuals to whom the selected test was administered by a respective test 
administrator in a respective testing session. 

13. The method of Claim 11 or 12 wherein act (c) comprises 
identifying selected ones of the sub-group profiles that are characterized by a 
low correlation with the normative profile. 

14. The method of Claim 11 or 12 wherein act (c) comprises 
comparing (1 ) at least two portions of each sub-group profile that differ in 
question difficulty against (2) corresponding portions of the normative profile. 

15. The method of Claim \l or 12 wherein act (c) comprises 
comparing (1 ) a difference between at least a portion of each of the sub-group 
profiles and a corresponding portion oUhe normative profile on a question-by- 
question basis; and (2) a measure of expected variability of sub-group 
performance for the corresponding portiori of the sub-group profiles. 

16. The method of Claim 11 or 12 wherein act (c) comprises 
comparing (1 ) a measure of difference between a first portion of each of the 
sub-group profiles and a corresponding first portion of the normative profile 
and (2) a measure of difference between a second portion of each of the sub- 
group profiles and a corresponding second portion of the normative profile. 
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iY. The method of Claim 11 or 12 wherein act (c) comprises 
identifyingSySuccessive equal values in each of the sub-group profiles of (a). 

18. \he method of Claim 11 or 12 wherein act (a) comprises: 
(alY providing a respective individual profile for each of a 

5 plurality of individuate that took the standardized test, each individual 

associated with a respective one of the sub-groups, each individual profile 
indicative of accuracy of the respective individual in answering the plurality of 
questions on a question-by-^estion basis; and 

(a2) determining\each sub-group profile from the individual 
profiles of the individuals in the respective sub-group, each sub-group profile 
;S indicative of accuracy of the individual in the respective sub-group in 

S E answering the questions on a question-b^question basis. 

19. The method of Claim 11 or 12 wherein the sub-group profiles of 
HP (a) are each characterized by a skill level, and wherein the normative profile of 
rt 5 (b) is indicative of expected sub-group performancesfor a sub-group of said 

Jff skill level. \ 

Q 20. The method of Claim 1 1 or 12 wherein the nomnative profile of 

" (b) is indicative of expected sub-group performance for sub-gtoups of a wide 

range of skill levels. \ 
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